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DETAILED ACTION 

1 . This action is responsive to communications: RCE, filed on 10/18/06. 

2. Claims 1-14, 16-20, 22-26 are pending in the case. Claims 1 , 12, 16, 20, 22 and 
26. Claim 1 has been amended. Claims 15, 21 and 27 are canceled. 

Claim Rejections - 35 USC § 101 

1. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claims 1-14 and 22-26 are rejected under 35 U.S.C. 101 because the claimed invention 
is directed to non-statutory subject matter. Claims 1 and 12 do not include claim 
language that indicates for example, display of the object region data, which illustrates a 
manipulation of data for output to computer display that physically transforms the article 
or object to a different state or thing. Therefore the claim language does not present a 
practical application by physical transformation or production of a useful, concrete and 
tangible result to form the basis of statutory subject matter under 35 U.S.C. 101 . 
Additionally, claims 22 and 26 recite "a computer readable medium having computer 
readable program code...". The claim recitation does not permit the program 
functionality to be realized by claiming computer-readable medium encoded with a 
computer program as a computer element, which defines structural and functional 
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interrelationships between the computer program and the rest of the computer or a set 
of instructions capable of being executed by a computer. Examiner suggests the 
following: "... a computer readable medium embodied with a computer program. . .". 
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Double Patenting 

2. The nonstatutory double patenting rejection is based on a judicially created 
doctrine grounded in public policy (a policy reflected in the statute) so as to prevent the 
unjustified or improper timewise extension of the "right to exclude" granted by a patent 
and to prevent possible harassment by multiple assignees. A nonstatutory 
obviousness-type double patenting rejection is appropriate where the conflicting claims 
are not identical, but at least one examined application claim is not patentably distinct 
from the reference claim(s) because the examined application claim is either anticipated 
by, or would have been obvious over, the reference claim(s). See, e.g., In re Berg, 140 
F.3d 1428, 46 USPQ2d 1226 (Fed. Cir. 1998); In re Goodman, 1 1 F.3d 1046, 29 
USPQ2d 2010 (Fed. Cir. 1993); In re Longi, 759 F.2d 887, 225 USPQ 645 (Fed. Cir. 
1985); In re Van Ornum, 686 F.2d 937, 214 USPQ 761 (CCPA 1982); In re Vogel, 422 
F.2d 438, 164 USPQ 619 (CCPA 1970); and In re Thorington, 418 F.2d 528, 163 
USPQ 644 (CCPA 1969). 

A timely filed terminal disclaimer in compliance with 37 CFR 1 .321 (c) or 1 .321 (d) 
may be used to overcome an actual or provisional rejection based on a nonstatutory 
double patenting ground provided the conflicting application or patent either is shown to 
be commonly owned with this application, or claims an invention made as a result of 
activities undertaken within the scope of a joint research agreement. 

Effective January 1, 1994, a registered attorney or agent of record may sign a 
terminal disclaimer. A terminal disclaimer signed by the assignee must fully comply with 
37 CFR 3.73(b). 

3. Claims 1,16 and 22 are rejected on the ground of nonstatutory obviousness-type 
double patenting as being unpatentable overclaim 1 of U.S. Patent No. 6,810,148 B2. 



Although the conflicting claims are not identical, they are not patentably distinct from 



each other because 




Present Invention Claims: 


US 6,810,148: 


Generating a polygon approximating a 


Specifying a type of figure, corresponding 


contour of the object region in each of the 


to the object region, to be a rectangle and 


at least three frames, the polygon having 


a number of vertices which are 


vertexes 


representative points of the figure 
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Associating each of the vertexes in each of 
the frames with each of the same vertexes 
in an adjacent frame 


Time data. . .of the object region in the 
video sequence; figure data specifying a 
trajectory of vertices, including; time 
arrangemem. . .ot poinis, ano Tunciion aaia 
indicating the trajectory of... vertices using 
information indicating an order of a 
function 


Obtaining trajectories, each of the 
trajectories linking the same vertexes 

UIIUULJII lllc ildlllco UdocU Ull lilt; 11 1 1 1 1?- 

series variation of the frames; and 


Figure data specifying a trajectory of the 
vertices, including; time arrangement data 
inciuuing iimes ot points useo 10 ueiermme 
the trajectory, where the time data 
includes a start time and a duration time of 
the object region in the video sequence 


Generatino the obiect reaion data thp 
object region data comprising an 
approximate function data expressing the 
trajectories 


npeprjhjnri informatinn for a mnvinn nhiont 
l/couiumi^ ii iiui 1 1 iciuui i a iiiuviiiy uujcoi 

region in a video sequence... function data 
for indicating the trajectory... the function 
data being described by another integer 



US 6180,148 fails to specifically disclose at least three frames through which associated 
vertices of adjacent frames have linked trajectories. 

It would have been obvious to one of ordinary skill in the art at the time of 
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invention to include at least three frames through which vertices of adjacent frames 
have linked trajectories with the teachings of US 6,810,148 because US 6,810,148 
teaches video has the same object in continuous frames, where approximation of the 
region with the figure is performed for each frame and may be performed by using a 
result of extraction of a plurality of preceding and following frames (col. 1 1 , II. 5-12, 55- 
61). 

One of ordinary skill in the art would have been motivated to include at least 
three frames through which vertices of adjacent frames have linked trajectories with the 
teachings of US 6,810,148 for the advantage of smoothing the movement and 
deformation of the approximate figure as the size and position of the figure changes 
through multiple frames of video. 

As per independent claim 16, US 6,810,148 discloses an apparatus (claim 1; Fig. 1; col. 
2, II. 40-67) for implementing the method of claim 1. Therefore, the rationale as applied 
in the rejection of claim 1 applies herein. 

As per independent claim 22, US 6,810,148 discloses program means (col. 13, II. 1-2) 
for implementing the method of claim 1 . Therefore, the rationale as applied in the 
rejection of claim 1 applies herein. 
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Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 Of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 1-14, 16-20 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Jin-Hun Kim, U.S. Patent 5,883,977, 3/1999. 

As per independent claim 1, Kim discloses generating a polygon approximating a 
contour of the object region in each of the frames, the polygon having vertexes (col. 3, 
II. 23-30); associating each of the vertexes in each of the frames with each of the same 
vertexes in an adjacent frame (i.e. mapping the vertices between predicted vertices and 
motion compensated vertices) (col. 3-4, II. 60-15); obtaining trajectories, each of the 
trajectories linking the same vertexes through the frames for each video frame 
sequence of digital data (i.e. use of a global motion vector, GMV, to determine the 
amount of shift of pixels of the current and the predicted contours) (col. 3, II. 30-60); and 
generating the object region data, the object region data comprising an approximate 
function data expressing the trajectories (i.e. using a line to approximate the 
trajectories) (col. 5-6, II. 64-5; col. 6, II. 48-60). 

Kim fails to expressly disclose at least three frames and linking the same 
vertexes through the frames based on the ti me-series variation of the frames. 
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It would have been obvious to one of ordinary skill in the art to include at least 
three frames in the method of Kim because Kim teaches an improved method of 
processing contour information which is used in MPEG coding of transmitted video 
image data that is processed on a plane/frame (VOP, video object plane) by 
plane/frame basis, where the plurality of planes/frames includes at least three (col. 1 , II. 
30-60). Additionally, it would have been obvious to one of ordinary skill in the art to 
include linking the same vertexes through the frames based on the time-series variation 
of the frames in the method of Kim because Kim teaches performing motion 
compensation to generate intra/inter-coded data (abstract), which is a conventional 
compression technique that uses similarities between successive image frames, 
referred to as temporal or inter-frame correlation, to provide moving image 
representations. One of skill in the art would have been motivated to include at least 
three frames having linked vertices based on time variation of the frames in the method 
of Kim because frames are a timed sequence of digital data that together represent 
video; and linking the vertexes of at least three frames based on time enables the 
determination of the change in motion between all successive frames of the video. 

As per dependent claims 2 and 17, Kim discloses the vertexes in each of the at least 
three frames are associated each of the same vertexes in the adjacent frame such that 
a distance between each of the vertexes in each of the at least three frames and each 
of the same vertexes in the adjacent frame is minimum (col. 3, II. 60-66). 
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As per dependent claim 3, Kim discloses the distance between each of the vertexes in 
each of the at least three frames and each of the same vertexes in the adjacent frame is 
calculated after a center of gravity of the polygon in each of the at least three frames 
coincides with a center of gravity of the polygon in the adjacent frame (col. 3, II. 32-38). 

As per dependent claims 4, 7 and 10, Kim discloses the trajectories are respectively 
approximated by predetermined functions, and the object region data is generated by 
using the functions (col. 3, II. 30-38). 

As per dependent claims 5, 8 and 1 1 , Kim discloses the object region data includes 
position data of the vertexes (col. 3, II. 41-45) of each of the at least three frames and 
association data indicting correspondence of the vertexes between the frames (col. 4, II. 
6-15). 

As per dependent claims 6 and 18, Kim discloses the associating each of the vertexes 
with each of the same vertexes comprises estimating vertexes in the adjacent frame 
based on the trajectories (i.e. determining a predicted vertex) (col. 3, II. 60-63), and 
selecting the vertexes in the adjacent frame, that are closest to the estimated vertexes 
(col. 3, II. 64-66). 

As per dependent claims 9 and 19, discloses the associating each of the vertexes with 
each of vertexes comprises obtaining a characteristic quantity (i.e. distance) of the 
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vertexes of each of the frames (col. 3, II. 60-67) and associating the vertex in each of 
the at least three frames and the same vertex in the adjacent frame which have the 
closest characteristic quantity (col. 4, II. 10-15). 

As per independent claim 12, Kim discloses generating a polygon approximating a 
contour of the object region in the at least three frames, the polygon having vertexes 
(col. 3, II. 23-30); associating each of the vertexes in each of the at least three frames 
with each of the same vertexes in an adjacent frame (col. 3-4, II. 60-15); obtaining 
trajectories, each of the trajectories linking the same vertexes through the at least three 
frames (col. 3, II. 30-60); estimating positions of vertexes of a polygon in a next frame 
based on trajectories, the next frame following a last frame of the at least three frames 
for which the trajectories are obtained (col. 5, II. 46-54); moving the position-estimated 
vertex in accordance with a contour of the object region in the next frame (col. 3, II. 44- 
49); updating the trajectories by associating each of the moved vertexes with 
trajectories linking the vertexes which are the same as the moved vertexes (col. 5, II. 
35-55); and generating the object region data, the object region data comprising an 
approximate function data expressing the updated trajectories (col. 5-6, II. 64-5col. 6, II. 
48-60). The rationale as applied in the rejection of independent claim 1 applies herein. 

As per dependent claim 13, Kim discloses the trajectories are respectively 
approximated by predetermined functions, and the object region data is generated by 
using the functions (col. 3, II. 30-38). 
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As per dependent claim 14, Kim discloses the object region data includes position data 
of the vertexes (col. 3, II. 41-45) of each of the at least three frames and association 
data indicting correspondence of the vertexes between the at least three frames (col. 4, 
11.6-15). 

As per independent claim 16, Kim discloses an approximation unit (Fig. 1 "201"), an 
association unit (Fig. 1 "220"); a trajectory obtaining unit (Fig. 1 "280") and an object 
region data generation unit (Fig. 1 "260") for implementing the method of claim 1 . 
Therefore the rationale applied in the rejection of claim 1 applies herein. 

As per independent claim 20, Kim discloses an approximation unit (Fig. 1 "201"), an 
association unit (Fig. 1 "220"); a trajectory obtaining unit (Fig. 1 "280"); an estimation 
unit (Fig. 1 "250"); a moving unit (Fig. 1 "280"); an updating unit (Fig. 1 "250"); and an 
object region data generation unit (Fig. 1 "260") for implementing the method of claim 
12. Therefore the rationale applied in the rejection of claim 12 applies herein. 
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3. Claims 22-26 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Jin-Hun Kim, U.S. Patent 5,883,997, 3/1999, and further in view of Aggelos Katsaggelos 
et al., "MPEG-4 and Rate-Distortion-Based-Shape Coding Techniques", Proceedings of 
the IEEE, Vol. 86, No. 6, June 1 998. 

As per independent claim 22, Kim discloses generate a polygon approximating a 
contour of the object region in each of the frames, the polygon having vertexes (col. 3, 
II. 23-30); associate each of the vertexes in each of the frames with the same vertexes 
in an adjacent frame of each of the frames (i.e. mapping the vertices) (col. 4, II. 6-15); 
obtain trajectories, each of the trajectories linking the same vertexes through the frames 
for each video frame sequence of digital data (col. 4, II. 6-15); and generate the object 
region data, the object region data comprising an approximate function data expressing 
the updated trajectories (col. 5-6, II. 64-5col. 6, II. 48-60). 

Kim fails to expressly disclose at least three frames and linking the same 
vertexes through the frames based on the time-series variation of the frames. Kim also 
fails to disclose computer readable program code means. 

Katsaggelos discloses an application for an coding algorithm like object based 
analysis synthesis coding which uses object shape, texture and motion to describe 
moving video objects (pp. 1 , col. 2, Para 1). 

It would have been obvious to one of ordinary skill in the art to include at least 
three frames in the method of Kim because Kim teaches an improved method of 
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processing contour information which is used in MPEG coding of transmitted video 
image data that is processed on a plane/frame (VOP, video object plane) by 
plane/frame basis, where the plurality of planes/frames includes at least three (col. 1 , II. 
30-60). Additionally, it would have been obvious to one of ordinary skill in the art to 
include linking the same vertexes through the frames based on the time-series variation 
of the frames in the method of Kim because Kim teaches performing motion 
compensation to generate intra/inter-coded data (abstract), which is a conventional 
compression technique that uses similarities between successive image frames, 
referred to as temporal or inter-frame correlation, to provide moving image 
representations. One of skill in the art would have been motivated to include at least 
three frames having linked vertices based on time variation of the frames in the method 
of Kim because frames are a timed sequence of digital data that together represent 
video; and linking the vertexes of at least three frames based on time enables the 
determination of the change in motion between all successive frames of the video. Also, 
it would have been obvious to one of ordinary skill in the art to have Kim's object region 
data generation include Katsaggelos' application as a computer readable program code 
means because dynamic programming improves, the use of a prediction method that 
uses shape coding of a polygon approximation along with motion modeling to describe 
object region deformation. 

As per dependent claim 23, Kim discloses the vertexes in each of the at least three 
frames are associated each of the same vertexes in the adjacent frame such that a 
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distance between each of the vertexes in each of the at lest three frames and each of 
the same vertexes in the adjacent frame is minimum (col. 3, II. 60-66). 

As per dependent claim 24, Kim discloses the associating each of the vertexes with 
each of the same vertexes comprises estimating vertexes in the adjacent frame based 
on the trajectories (i.e. determining a predicted vertex) (col. 3, II. 60-63), and selecting 
the vertexes in the adjacent frame, that are closest to the estimated vertexes (col. 3, II. 
64-66). 

As per dependent claim 25, discloses the associating each of the vertexes with each of 
vertexes comprises obtaining a characteristic quantity (i.e. distance) of the vertexes of 
each of the at least three frames (col. 3, II. 60-67) and associating the vertex in each of 
the frames and the same vertex in the adjacent frame which have the closest 
characteristic quantity (col. 4, II. 10-15). 

As per independent claim 26, Kim discloses generating a polygon approximating a 
contour of the object region in at least three frames, the polygon having vertexes (col. 3, 
II. 23-30); associating each of the vertexes in each of the at least three frames with each 
of the same vertexes in an adjacent frame (col. 4, II. 6-15); obtaining trajectories, each 
of the trajectories linking the same vertexes through the at least three frames (col. 4, II. 
6-1 5); estimating positions of vertexes of a polygon in a next frame based on 
trajectories, the next frame following a last frame of the at least three frames for which 
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the trajectories are obtained (col. 5, II. 46-54); moving the position-estimated vertex in 
accordance with a contour of the object region in the next frame (col. 3, II. 44-49); 
updating the trajectories by associating each of the moved vertexes with trajectories 
linking the vertexes which are the same as the moved vertexes (col. 5, II. 35-55); and 
generating the object region data, the object region data comprising an approximate 
function data expressing the updated trajectories (col. 5-6, II. 64-5; col. 6, II. 48-60). 

Kim fails to specifically disclose at least three frames and a computer readable 
program code means. 

Katsaggelos discloses an application for an coding algorithm like object based 
analysis synthesis coding which uses object shape, texture and motion to describe 
moving video objects (pp. 1, col. 2, Para 1). 

The rationale as applied in the rejection of claim 22 applies herein. 
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Response to Arguments 

4. Applicant's arguments filed 10/18/06 have been fully considered but they are not 
persuasive. 

Applicant argues (pp. 12, Para 1) Kim does not teach associating the vertexes in each 
of at least three frames. 

In response, Kim teaches mapping the vertices between predicted vertices and 
motion compensated vertices (col. 3-4, II. 60-15). Therefore, Kim teaches 
associating the vertexes in each of the frames. Additionally, Kim teaches an 
improved method of processing contour information which is used in MPEG 
coding of transmitted video image data that is processed on a plane/frame (VOP, 
video object plane) by plane/frame basis, where the plurality of planes/frames 
includes at least three (col. 1, II. 30-60). The processing of video data present in 
a plurality of planes/frames suggests that Kim teaches processing 
contour/trajectory information for video data over the plurality of planes/frames, 
which includes at least three frames. 

Applicant argues (pp. 12, Para 2) Kim does not teach obtaining trajectories, with each of 
the trajectories linking the same vertexes thought the at least three frames based on the 
time-series variation of the at least three frames. 
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In response, Kim teaches aligning centers of gravity of two polygons such that 
the distance between the vertices of the polygons in adjacent frames is a 
minimum (col. 3-4, II. 15-35), which results in the linking of associated vertices as 
Applicant's Specification also indicates (Specification pp. 15-16, II. 10-10). 
Therefore, Kim teaches obtaining trajectories linking vertexes through frames. 

Additionally, Kim teaches an improved method of processing contour information 
which is used in MPEG coding of transmitted video image data that is processed 
on a plane/frame (VOP, video object plane) by plane/frame basis, where the 
plurality of planes/frames includes at least three (col. 1 , II. 30-60). The 
processing of video data present in a plurality of planes/frames suggests that Kim 
teaches processing contour/trajectory information for video data over the plurality 
of planes/frames, which includes at least three. 

Kim also teaches performing motion compensation to generate intra/inter-coded 
data (abstract), which is a conventional compression technique that uses 
similarities between successive image frames, referred to as temporal or inter- 
frame correlation, to provide moving image representations. Therefore Kim 
teaches temporal or time varied image frames. 

Applicant argues (pp. 12, Para 3) Kim does not teach generating the object region data 
comprising an approximate function data expressing the trajectories. 
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In response, Kim teaches using a line to approximate the trajectories (col. 5-6, II. 
64-5; col. 6, II. 48-60). Therefore, Kim teaches an approximate function data expressing 
the trajectories. 

Based on the above provided rationale, the claims do not patentably distinguish 
over the applied prior art. 
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Conclusion 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Chante Harrison whose telephone number is 571-272- 
7659. The examiner can normally be reached on Monday-Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kee Tung can be reached on 571-272-7794. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



Chante Harrison 
Examiner 
Art Unit 2628 



ch 

January 4, 2007 




